(19) 



J) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




(12) 



(43) Date ol publication: 

26.06.1996 Bulletin 1996/26 

(21) Application number: 95500171.4 

(22) Date of filing: 19.12.1995 



IIIHHHII1 

dD EP 0 718 809 A2 

EUROPEAN PATENT APPLICATION 

(51) IntCI 6: G07D7/00 



(84) Designated Contracting States: 

AT BE CH DE DK FR GB GR IE IT LI LU MC NL PT 
SE 

(30) Priority: 23.12.1994 ES 9402631 

(71) Applicant: AZKOYEN INDUSTRIAL, S.A. 
E-31350 Peralta (Navarra) (ES) 

(72) Inventors: 
• Echapare Ibarrola, Jesus 

31007 Pamplona (Navarra) (ES) 



• Ormaxabal Aramburu, Angel 
20500 Modragon ( Guipuzcoa) (ES) 

(74) Representative: 

Gomez-Acebo y Pombo, Jose Miguel 
c/o CLARKE, MODET & Co., 
Avda. de los Encuartes, No. 21 
28760 Tres Cantos (Madrid) (ES) 



(54) 



Amethodandappamtusforcharacterizingandd^ 



(57) A method and apparatus for the characteriza- 
tion and discrimination of bank notes and documents 
that are legal tender, the method for which is based on 
break down of the surfaces of documents into different 
characteristic zones, for the posterior detailed analysis 
of each zone under special conditions which are deter- 
mined according to the characteristics of each. The 
method includes a process for self -calibration of the ap- 



paratus together with another for the automatic center- 
ing of documents. The apparatus includes an optical 
system composed of plates (3 and 4) between which the 
document moves, at least one mirror (11) which directs 
the image at a lineal photosensor (8), a diaphragm (10) 
which corrects luminosity and focus, and a meniscus 
lens (9). there also being a source of infrared illumina- 
tion (13) and a broad spectrum light source (14). 
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Description 



This invention relets to a method for characterizing 
and discriminating bank notes and legal currency, by 
means of analysis of the colouration of images obtained 
fromthesaidbanknotesorcurrency. The invent.™ also 
includes the apparatus for carrying out the said method 
More specifically, the method of the invention is of 
the type which includes the transport of the note or cur- 
rency document to be analyzed along the length of a 
trajectoiy in which the said document is illuminated and 
images are obtained for the posterior analysis of the col- 
ouration of the same. 

The use of point sensors is a known technique for 
obtaining images, these permitting the observation^ a 
certain number of lines throughout the whde length of 
the document. In this respect patents US 3679314 GB 
1470737 and US 4618257 may be mentioned, in which 
light signals are detected by broad spectrum photosen- 
sorization, including illumination of ^ 
chromatic light sources, as well as patents EP 395833 
GB 2064101, GB 2192275 and US 4618257. in which 
the light signal is detected by narrow band photosen- 
sors each of which is sensitive to a specific colour, wh.le 
the document is illuminated by broad spectrum light. 

The use of lineal sensors is ateoa known technique 
for capturing images, these permitting the observation 
of the entire surface of the document. Patents EP 
78708 GB 208B051 and EP 537513 belong to this 
group,' in which light signals are captured by means o 
broad spectrum photosensorization and illumination of 
notes by monochromatic light sources, as well as US 
patent 4922109. in which the light signal is detected by 
broad spectrum photosensors, each of which is sensi- 
tive to a specific colour, the document being illuminated 
by broad spectrum light. Spanish patent application P 
9302692 by the same applicants may also be mentioned 

as falling within this group, this referring to a method 
which is based on the usage of a red - green - blue sen- 
sor which itself supplies information on each red. green 
and blue component, the document preferentially being 
illuminated by broad spectrum light sources. 

The method which is the object of this invention be- 
longs to the second of the groups mentioned, in which 
images are acquired by the usage of lineal sensors typ- 
ically lineal CCD sensors (monochrome or RGB cotour) 
or triads of photodiodes with red. green and blue filters. 

In any of the systems described, documents are an- 
alyzed by methodology which is independent of the de- 
nomination of the note and its position on being intro- 
duced, which, together with the image acquisftion sys- 
tem, means that the rejection of forgeries and the ac- 
ceptance of legal notes are not sufficiently reliable. 

The object of this invention is a method for discnm- 
inating bank notes and legal currency, hereunder bank 
notes based on the division of the same into areas for 
specific analysis and their posterior treatment, as is de- 
scribed below. 



The method which is the object of the invention 
achieves a greater degree of security in the rejection of 
falsifications, together with an improved ™ x °«*™? 
ance of legal notes. Another outstanding advantage erf 
s the method covered by the invention is the increased 
ease with which notes are introduced, due to increased 
tolerance of variations in the position of the same at the 
start ot the process. 

It is known that bank notes include different types 
10 of print(engraving. mhography...) and different inks Jnte 
visWoinfrared radiation, inksof different colours wrth- 
in the visible spectrum, inks that become fluorescent un- 
der uttraviolet illumination, etc.) and different secunty 
teatures. such as. water marks, embedded securrty 
is threads, holograms, ... 

It may therefore be concluded that each note 
presents certain zones wh«h are of interest for analysis 
such as those defined by engraved printing, fluorescen 

fibres, water marks, security threads, etc.. whKh , differ 
20 accordingtothedenominationofm^^ 

pattern or characters lhat are shown together wrth their 

position on the note. . . 

As opposed to existing procedures for anafyzing 
notes by a methodology which is independent of the de- 

duced, this process proposes a methodology that e 
completely dependent on the denomination of notes and 
£Hay L they are introduced, due to the breaking 
down of the surface of the note into as many zones or 
30 areas to be studied as there are elements of interest on 
the note which it is wished to recognize. 

According to the method of the invention, during an 
initial phase the possible denomination of the no* . and 
the position in which it is introduced are determined by 
35 measurement of its width and the identification of some 
of those characteristics which are present on the initial 

zone of the document. . .. 

For each type of note and position of introduction 
analysis of the same will be undertaken by the study of 
<o specie zones. These said zones are to be Refined I by 
the coordinates of their edges respecting then onginal 
edges of ihe note and are to be circumsenbed. within 
the tolerances that are advisable for each case, to the 
different areas of interest on the note, such as. mot fs 
AS whichcoincideontheupperandlowersidesoft^note 
watermarks, security threads, holograms, predominant 
coloured signs, the area of the series number, alphanu- 
merical character areas, ... , . Qeno 

For each of these areas the following are to be spe- 
50 cifically assigned: . 

The illumination used: suitable illumination is to be 
usedfor each zone tobe analyzed. Thus infrared illumi- 
nation is to be used to detect the existence of inks that 
are absorbent within the infrared spectrum. Broad spec- 
55 trum visible illumination is to be used for those areas ,<n 
which it is wished to undertake chromatic analyse. Ul- 
traviolet illumination is to be used for zones containing 
fluorescent substances. Illumination by a combination 
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of sources may be of interest in some zones, for exam- 
ple visible light together with infrared light. The level of 
illumination is to be graduated by the electronic device 
that is suitable for each zone according to the level of 
light absorption of the inks in the said zone, thereby at- 
taining suitable levels of contrast. I llumination is likewise 
to be set to transmission or reflection for each zone, and 
it is to be possible to combine both. 

- The speed of the transport system: by the lineal 
sensor used and the note transport system, an im- 
age is to be gained of each zone that is subjected 
to analysis. This said digitalized image is to be 
stored in the form of a two dimensional matrix, one 
dimension of which corresponds to the number of 
elements of the lineal photosensor focused within 
the zone, and the other dimension to the number of 
lines acquired during the sweep of the zone. 

One of the forms of modifying the number of 
lines acquired in each zone consists of varying the 
speed at which the note is transported, such that to 
increase definition in the direction in which notes 
move forward the speed of transport will be reduced 
and vice versa, a suitable speed of transport being 
programmed for the analysis of each zone. 
- The resolution and sensitivity of the capture system, 
depending on the degree of detail required in the 
capture of the image which is the object of analysis 
within each zone, a certain level of resolution is to 
be set. Crosswise resolution is to be a function of 
the number of elements in the lineal photosensor 
that are taken into account, e.g., all the elements, 
one of each couple (half resolution) one of each 
three .... Longitudinal resolution may be modified 
by varying the time of acquisition between two lines 
or the speed of the transport system (the section 
above). For some zones it is of interest to modify 
the sensitivity of the image sensor system, e.g. in 
areas that are strongly absorbent (very dark) results 
are improved by modifying the measurement range 
of the sensor system. 
- The processing of the signal and the obtention of 
particular parameters for each zone: information 
obtained following digitalization of the image ac- 
quired in each zone is typically to take the form of 
a two dimensional matrix for each colour compo- 
nent. 



On the basis of the three two dimensional matrixes 
(one for each colour component R » G » B ) obtained for 
each zone, the identifying parameters for the said zone 
are to be defined, which together with the parameters 
that identify the remaining zones that are subject toanal- 
ysis are to serve for validation of the inspected note ac- 
cording to the results of the comparison to be estab- 
lished with the parameters that are stored within the 
memory and which correspond to similar zones as es- 
tablished for standard notes. 



A first group of the said parameters is to be com- 
posed of the parameters which we define as statistical, 
these being obtained directly from the above - men- 
tioned two dimensional matrixes (these said matrixes 
5 representing the distribution of colour levels in the zone 
analyzed). The statistical parameters calculated on the 
basis of the elements within the fundamental colour ma- 
trixes may be: the mean, typical deviation, total range, 
upper range, lower range, points around the average, 
w upper average and lower average, etc.. tor each one of 
the distributions of fundamental colours. 

As well as the statistical parameters described 
above which are obtained from each one of the three 
colour matrixes, it is also of interest to make use of the 
is relationships between the same to obtain relative pa- 
rameters that are more stable when variations occur due 
to ageing, dirt, temperature, 

Nevertheless, the usage of statistical parameters 
gives rise to a certain degree of uncertainty, as hypo- 
20 thetically the case may arise in which a matrix obtained 
from an image different from that corresponding to the 
zone under analysis but having a distribution of colour 
levels such that statistical parameters similar to the cor- 
rect ones are obtained. This is the reason why the level 
25 of security is increased by comparison of the parame- 
ters, using complementary parameters also obtained 
from colour distribution matrixes. These said new pa- 
rameters are extracted from the curves which we define 
as colour profiles throughout the principal dimensions 
30 of the zone. These said dimensions may be longitudinal, 
crosswise and the two oblique angles (at 45° to the pre- 
vious ones and at 90° to each other). 

Colour profile curves are extracted from colour level 
distribution matrixes. To extract the colour profile curve 
35 according to any of the principle dimensions, the matrix 
is run through along the dimension selected, with graph- 
ic representation of the values which at each position of 
the dimension selected attain a function of the elements 
within the matrix contained within the dimension perpen- 
40 dicular to that selected. (The value reached at each po- 
sition is to be a function of the elements of the dimension 
perpendicular to that selected, for example its sum, 
mean or any other function). As an example the case 
may be taken of one of the colour distribution matrixes 
45 of a zone under analysis being green, and constructed 
of n rows and m columns. The values of each row are 
considered identical and increase by one unit in the next 
row according to the succession 0,1,2,3,4, ... Thus to 
find the curve of the green profile in the said matrix ac- 
so cording to the crosswise dimension, that is along the 
length of the rows (longitudinal dimension being along 
the columns while oblique dimensions are along the di- 
agonals), the value attained by the function to be applied 
to each element within it is found for each row (for ex- 
55 ample, their mean) and the values obtained for each row 
are shown graphically according to the row which they 
correspond to. A straight line would be obtained in the 
example cited. Points of the curve are obtained by rep- 
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resenting pairs of values corresponding to the number 
of the file and the value calculated for each of them by 
coordinates (see Figure 10). 

The straight line of the example would be a case of 
the profile of a very special colour A curve that is more 
similar to a real case could be that shown in the graph 

of Figure 11. * _ ^ 

Once the colour profile curves have been obtained, 
for each one the parameters associated with it and con- 
sidered to be of interest may be extracted, such as: ab- 
solute maximum and minimum, relative maximum and 
minimum, the interval between maximums, points of in- 
flection, intervals of zero slope, etc.; thus this attempts 
to establish the comparison between the extracted col- 
our curves and those which are stored as standards by 
comparing the above - mentioned respective parame- 
ters 

The use of all Ihe parameters extracted from the col- 
our profile curves and the statistical parameters is a very 
powerful and safe tool for the validation of the zones 
which are being subjected to analysis. Zone validation 
arises from the comparison of the said parameters with 
those stored in the memory as standards. If a note is to 
be validated then all of the zone subjected to analysis 
have to be validated successfully. 

For each zone selected both optical resolution and 
sensitivity will be set, together with the speed of note 
transport, the system of illumination and parameters (of 
all those possible, only those which attain a certain de- 
gree of importance in validation of the zone will be con- 
sidered) which are most suitable tor the type of analysis 
to be undertaken in each case. 

Thus for example, infrared illumination by transmis- 
sion is to be used as a valid lighting method for gaining 
a contrasted image of a zone in which the main feature 
is a water mark, while a zone defined as being for chro- 
matic analysis will be illuminated by visible reflected 
white light, while optical resolution is to be a function of 
the level of detail required in analysis, etc. 

A special case of the analysis by zones as de- 
scribed occurs when a single zone is defined for a note, 
occupying a part or all of the same. 

Another special case of analysis arises when a sin- 
gle zone is subjected to double analysis. This means 
that once the zone in question has been analyzed under 
certain conditions, the reverse gear of the motor is ac- 
tivated followed by reactivation of forward transport so 
that the same zone is re-analyzed under different con- 
ditions (for^xample, another type of lighting or resolu- 
tion)- . 

As well as the methodology for the validation of 
notes by the zonal analysis described above, the inven- 
tion also includes an automatic centering process, by 
which notes are kept parallel to the axis ot the trajectory 
along which they are guided, and which permits, on con- 
dition that this parallel position is maintained, the intro- 
duction of notes in any position over the entry mouth, 
unlike currently existing introduction systems, which de- 



mand a uniform entry position, either with the notes rest- 
ing against one end of the entry mouth, or perfectly cen- 
tered respecting the axis of the said mouth, all ot this 
apptying to selectors which admit different types of note 
s and notes of different widths. 

Automatic centering is applicable in identification 
systems which use a lineal sensor with a field of vision 
that is greater than the width of notes. 

In a first phase the width of a note is measured by 
10 counting the number of photoelements which are inter- 
rupted when the said note is introduced. Infrared lighting 
by transmission would typically be used tor this purpose. 
The posrtion of the note with respect to the lineal sensor 
is determined by the position of the first and last pho- 
75 toelements that are interrupted in relation to the first 
photoelement within the lineal sensor. On the basis of 
this said positioningaxesaredisplaced and the first pho- 

toelement that is interrupted is set as the new origin or 
coordinates. This origin is used as the reference for 
20 each of the analysis zones defined for each denomina- 
tion of note. The position of the note throughout trans- 
port and analysis is continuously checked, to ensure 
that the axis of the note is parallel to the axis of transport. 
If a lack of parallel positioning is detected, then the proc- 
25 ess is interrupted and the note is rejected, grven that 
possible lack of exactitude in zonal analysis may arise. 

The main characteristic of the automatic centenng 
process consists of the fact that all types of note of less 
than maximum width may be analyzed conectly, how- 
30 ever crosswise they are located on introduction. 

Another feature covered by this patent consists of 
the phase of setf - calibration used for compensating tol- 
erances in the manufacture of the image acquisition sys- 
tem together with those deriving from the said system 
as in usage over time and variations in ambient conditions^ 
The setf - calibration phase adjusts the response of 
the photosensor and illumination systems such that 
identical and uniform resutts are achieved on analyzing 
thesamenoteunderdifferent conditions and by different 

40 analysis units (different note validators). 

Serf - calibration is applied to correct differences in 
the sensitivity and darkness cunent of the photoele- 
ments which compose the lineal sensor, as well as the 
different levels of emission of light sources ansing due 
45 to manufacturing tolerances as well as those deriving 
from ageing or environmental factors. In the first place, 
in the absence of a note and without lighting, the pho- 
toelements of the lineal sensor are read and the result- 
ing values are stored in the memory. These said values 
so are taken as reference for zero signal. Again without a 
note being in place a preferably white reference surface 
having a similar size to the field of vision of the lineal 
detector used is illuminated. Readings corresponding to 
each of the photoelements of the lineal sensor are taken 
55 for eachof the available types of illumination. Thevalues 
readarestoredinthememory,andrepresentthebonom 

of the scale of the measuring system, or a percentage 

of the same. 



4 



7 ' 



EP0718809 A2 



8 



During the subsequent process of reading a note, 
each of the calibration values corresponding to each 
photoelement and type of illumination is used, with the 
aim of normalizing readings taken of the note which is 
being examined. 

The apparatus for carrying out the method de- 
scribed includes means of transporting and guiding the 
document to be analyzed, means of illuminating the said 
document, means of acquiring images composed of a 
lineal photosensor and electronic means of signal 
processing. 

According to the invention the apparatus includes 
an optical system which is composed of: a) two overlay- 
ing plates that are parallel and close to each other, the 
lower one of which is translucent and has a diffusor sur- 
face, and the upper one of which is transparent, and be- 
tween which the notes pass in the observation zone; b) 
at least one frontal mirror which directs the image to- 
wards the lineal photosensor; c) a luminosity correcting 
and focussing diaphragm between the mirror and the 
lineal photosensor, and d) a meniscus lens located be- 
hind the diaphragm. 

In the apparatus of the invention the means of illu- 
mination are composed of an infrared light source, 
formed by a line of photodiodes which illuminate the 
document by transmission, and by a broad spectrum 
light source located so that it illuminates the document 
by reflection. 

The electronic signal processing equipment in- 
cludes a video amplifier, an analogue - digital converter 
and a microprocessor unit. These items of equipment 
also include a digital - analogue converter, the outputs 
from which control the range of the analogue - digital 
converter the reference level of the video amplifier and 
the level of illumination provided by the infrared and 
white light sources. 

The characteristics of the invention may be better 
understood by making use of the following description, 
which makes reference to the enclosed diagrams, in 
which a non-exclusive example of embodiment is 

shown. 

In the diagrams: 

Figure 1 shows a diagrammatic longitudinal section 
of an item of apparatus constructed according to the in- 
vention. 

Figure 2 shows in diagram form different forms ot 
diaphragms that may be used in the apparatus shown 
in Figure 1. 

Figure 3a is a diagram of the optical system includ- 
ed in the apparatus shown in Figure 1 . 

Figure 3b shows a variant of the execution of the 
optical diagram shown in Figure 3a. 

Figure 4 is a graph of the spectrum of the radiation 
corresponding to a white light source. 

Figure 5 represents the transmission characteris- 
tics of an optical filter which eliminates close infrared 
radiation, between 700 and 1100 nm. 

Figure 6 is a graph similar to that contained in Figure 



5, and represents the transmission characteristics of an 
optical filter which eliminates part of close infrared radi- 
ation. 

Figure 7 is a graph which shows the distribution 
s curve of the illumination obtained by the infrared or 
broad spectrum light sources. 

Figure 8 shows in diagram form the arrangement of 
the broad spectrum reflected light sources. 

Figure 9 is a block diagram of the electronic signal 
w processing and apparatus control system. 

Figure 10 includes the distribution matrix of the col- 
our levels of a zone of the document which is under anal- 
ysis together with the curve of profiles obtained from the 
said matrix, representing pairs of values corresponding 
is to row number and the value calculated for each in the 
form of coordinates. 

Figure 1 1 shows a curve similar to that in Figure 10, 
but in this case corresponding to an actual case. 

Figure 12 shows a possible subdivision of a docu- 
20 ment into different zones for analysis. 

The apparatus for identifying bank notes is com- 
posed of a system for the guiding and transport of notes, 
an image acquisition system and an electronic signal 
processing and apparatus control system. 
25 The transport and guide mechanism is composed 
of a motor (1 ) able to work in either direction, preferen- 
tially step by step, coupled to two transport pulleys (2) 
situated at either side of the zone used for analysis of 
the bank note which is channelled between two parallel 
30 plates (3) and (4). the transparent upper plate (3) being 
located in the reading zone, while the lower plate (4) is 
translucent white, this last item also carrying out the 
functions of a diffusor for the lighting system by trans- 
mission and the calibration surface. 
35 The reading zone consisting of a line (5) perpendic- 
ular to the axis ot the motion of the bank note has no 
mechanical elements whatsoever (such as transmis- 
sion belts, pulleys, etc.) which could perturb the perfect 
visibility of the whole of the note, by both transmission 
40 and reflection. 

At the ends of guide plates 3 and 4 pairs of photo- 
detectors (6) and (7) are to be placed, to detect the in- 
troduction of the note on one side and its admission on 
the other. 

45 The image acquisition system is composed ot an 
optical system and a lighting system. 

The optical system of the apparatus has the pur- 
pose of obtaining a suitable image on the surface of the 
lineal photosensor (8) based on the feature which is the 
so object of analysis as constituted by the line (5) that is 
crosswise to the direction of movement of the note, run- 
ning from one end to the other of the transport channel. 
The said line 5 together with the transport device creates 
the image of the entire bank note in which the zones that 
55 are the object of analysis are located, line by line. In Fig- 
ure 1, that shows the apparatus, the line visible to the 
optical system is shown in profile above point 5. 

The optical system is composed of: a lens (9), a di- 
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aphragm (1 0), a mirror (1 1 ) and an optical fitter (1 2). The 
lens (9) has been calculated to minimize distortion of the 
image obtained on the basis ol definition of the dimen- 
sions of the image, the object and the distance between 
the two, with the result that it is a meniscus lens having 
certain radii of curvature. To attain a suitable focus 
throughout the entire length of the lineal sensor and fun- 
damentally towards its ends, a rectangular diaphragm 
(10a) hastobe included (Figure 2). In the apparatus that 
is the object of the patent, the rectangular design of the 
diaphragm is modified by the inclusion of an aperture 
the size of which is increased towards the ends of the 
same so as to (as well as attaining suitable focus) com- 
pensate for the loss ol luminosity which occurs towards 
the ends and which is intrinsic to the type of lens used. 
Two designs of diaphragm are shown in Figure 2 (10b 
and 10c) both of which meet the above-mentioned ob- 
jectives. Compensation of luminosity over and above 
that attained by the diaphragm employed is attained by 
a distribution of the illumination, this being more intense 
towards the ends than it is at the centre of the line that 
is being subject to observation, as is shown in Figure 7. 

Between line 5 that is under observation and lineal 
photosensor (B) there are one or more mirrors (11 and 
11a) which have the purpose of reducing the space oc- 
cupied by the optical system. Figure'3a shows a dia- 
gram of an embodiment of a mirror (11 ). while Figure 3b 
shows two mirrors (1 1 a and 1 1 b). both of these arrange- 
ments meeting the relation a + b = a' + b' + c'.m which 
a = the distance between the line (5) under observation 
and the mirror (1 1 ), b = the distance between the mirror 
(11 ) and the lens (9), a' = the distance between line (5) 
under observation andmirror (11a), b' = the distance be- 
tween the mirrors (11a and 11b), and C = the distance 
between mirror (11b) and the lens (9). 

Given that halogen lamps are used as a white light 
source, together with the content of these lamps in terms 
of the infrared spectrum (see Figure 4), for certain doc- 
uments the chromatic analysis of the same may be im- 
proved by the elimination of this component with the in- 
clusion of an optical filter that totally absorbs the infrared 
part of the spectrum, which otherwise could give rise to 
alteration of the chromatic analysis within the visible 
spectrum. Figure 5 shows the response of an optical fil- 
ter of the type mentioned, in which infrared spectrum 
radiation is eliminated. 

Nevertheless, in other documents it is of interest 
(due to the mix of visible and infrared inks) to be able to 
use simultaneous illumination with white and infrared 
light. Depending on the desired proportions of infrared 
and visible light, the most appropriate infrared absorp- 
tion filter may then be designed. Figure 6 shows an ex- 
ample of a filter that partially absorbs infrared light, 
which may be used with photosensors having a re- 
sponse from 400 nm to 1100 nm of the spectrum (as is 
the case with silicon sensors). 

In Figure 1 , the location of the said infrared absorp- 
4 tion filter (1 2) may be seen. 



Two light sources are preferentially used in the illu- 
mination system of the image acquisition system: infra- 
red light by transmission and reflected broad spectrum 

5 In infrared light that is transmitted the emitters (1 3) 
are mounted grouped in a line along the lower part of 
the translucent dfflusor plate (4). The emitters are of the 
high efficiency LED type, and give illumination by trans- 
mission at a preferential wavelength of 880 nm or 950 
w nm To obtain intensified distribution of lighting at the 
ends, either a greater excitation current is used for the 
LEDs there, or the LEDs are more concentrated spatial- 
ly at the ends than they are at the central area. Figure 
7 shows the specific distribution curve for illumination 
is obtained by the usage of either procedure. 

Two halogen lamps (14) are used for illuminating 
the bank note with broad spectrum light on its upper sur- 
face through transparent plate (3). To attain a distnbu- 
tion of the illumination similar to that described for mfra- 
20 red illumination, each of the halogen lamps is located 
close to each end of line (5) which is the object of ob- 
servation, in the form as is shown by the diagram in Fig- 
ure 8. 

Lastly, the electronic signal processing and appa- 
2S ratus control system is shown in Figure 9, using a block 
diagram of the electronic system used. The electronic 
signal generated by the lineal photosensor (8) is proc- 
essed by the amplifier unit (15) and is digitalized in the 
analogue-digital conversion unit (16) to ready it tor 
so processing in the microprocessor unit (17). The micro- 
processor unit (17) may be composed of one or two mi- 
croprocessors, depending on the amount and complex- 
ity of the information to be processed. For example, if a 
colour CCD with a large number of pixels (1024 or more 
as pixels per colour component) is used as lineal photo- 
sensor, then it becomes of great interest to expressly 
dedicate one 1 6 bit microprocessor to the processing of 
the signal generated by the lineal sensor, and to use an 
auxiliary microprocessor tor the control of penpher.es 
40 (motor, lighting, inputs - outputs, ...) and auxiliary tunc- 

tions. , - 

The working sequence of the microprocessor unit 
together with the values representative of val.d bank 
notes are to be stored in the non-volatile memory unit 
45 (18). which is typically of the EPROM type. 

Likewise lorthe temporary storage of data acquired 
in the process of analyzing bank notes and the vanables 
used during the execution of the program a volatile 
memory (19) is to be used, typically one ol the dynamic 

so RAM type. 

The apparatus which is the object of this patent in- 
cludes a digital-analogue converter unit (20) connected 
to the microprocessor unit for usage in self-cal.brat.on 
and the normalization of acquired signals, 
ss During the setl-calibration process, which » carried 
out in the absence of bank notes, the first procedure is 
compensation of the darkness current of the lineal pho- 
tosensor. Acquisition of an image is earned out for this 



6 



11 



EP 0 718 809 A2 



12 



purpose (a line is acquired) without any illumination. The 
electric signal corresponding to the said acquisition rep- 
resents the darkness current ot the lineal photosensor. 
This said signal, once it has been digitalized and sent 
through the microprocessor unit, is sent on to the digital- 
analogue converter (20)forre-sending (channel A of the 
D/A converter) to the video amplifier unit (15) with the 
aim of annulling the value of the said darkness current. 
Following this the alternative connections to different 
light sources are made, acquiring the image of one Ime 
for each source. Each line acquired, once it has been 
suitably digitalized and sent through the microprocessor 
unit (17) to be stored in the RAM memory (19). In fact 
as many values are stored lor each type of illumination 
as there are elements within the lineal photosensor. 

In the phase during which bank notes are read and 
tor each of the successive lorms of illumination that are 
to be used, the values corresponding to each ot the el- 
ements of the lineal photosensor which were stored dur- 
ing self-calibration for the different light sources as de- 
scribed above are recovered from the RAM memory 

The said values or a mathematical function of each 
(e g a percentage, the inverse, the square, etc.) are 
applied to the digital-analogue converter (20) for usage 
as different minimum values of the scale in the A/D con- 
verter (16), in perfect synchronization with the acquisi- 
tion of each one of the lineal sensor elements (8). The 
corresponding output (channel B) from the D/A convert- 
er (20) is applied at the input of the range of measure- 
ment of the A/D converter (16) in such a way that the 
signal generated by each of the elements of the lineal 
photosensor has its own range of measurement sup- 
plied from the signal generated in the process of the self- 
calibration by the same element. It is thanks to this spe- 
cial self-calibration device that high overall image acqui- 
sition system stability is achieved against manufacturing 
tolerances, different ambient conditions and ageing. 

Additionally, the D/A converter (20) is also used as 
a means of control for changing the level of illumination 
(through its channel C) depending on the luminosity 
which has been defined for the analysis of each of the 
zones of interest, according to the process described 
above. 

Likewise it is possible to set the range of measure- 
ment of the A/D converter (1 6) to be suitable for the level 
of contrast of the image existing in each of the zones 
being analyzed, while this may result in a different range 
depending on the zone and type of bank note. This said 
modification in the range of measurement may be ob- 
tained either through output B channel, which was used 
in the process of self-calibration, or another output chan- 
nel D from the D/A converter (20) and which also acts 
on the range of measurement of the A/D converter (16). 
The apparatus described works as follows: 
The manual introduction of a bank note is detected 
at entrance mouth A by the pair of photoelements (6) 
placed there for this purpose. Once the entrance of a 



bank note has been detected, the bank note transport 
system is activated, this being composed ot one step by 
step motor (1) and rollers (2). the sett-calibration proc- 
ess being carried out while the bank note is being trans- 
s ported towards the zone of reading (5). 

Following the above steps the infrared by transmis- 
sion illumination system (13) is connected and awaits 
the arrival of the bank note at the reading zone (5) where 
it is rapidly detected by the electronic system of the ap- 
w paratus by the change produced in the signal captured 
by the lineal photosensor (8) which comes from the in- 
frared illumination (13). 

Inspection is then made of whether the bank note 
is correctly aligned with respect to the axis of the gusto- 
is way. For this purpose check is first made of the orthog- 
onality of the frontal edge of the bank note respecting 
the axis of the guideway, for which a narrow margin of 
a small number of successively acquired lines is con- 
ceded (one or two. or three at most) for which purpose 
20 all of the elements of the lineal photosensor, cone- 
sponding to a broad central zone within its field of vision 
shows the typical gradient of signal corresponding to frie 
presence of the note within this number of lines (while 
if this is not the case then the note is considered to be 
25 out of line and is rejected). The width of the bank note 
is then immediately measured and automatic centenng 
of thecoordinates of the imagecapture system iscarried 
out respecting the position of the note within the guide- 
way according to the procedures described above. 
30 once the width of the bank note is known then so 
too is its denomination. To know its position on entrance, 
analysis of one or more of its primary special zones is 
carried out for small sized notes, with the aim of rapidly 
detecting its entrance position, and by which the note is 
as classified (by its type and face on entrance). For exam- 
ple, in current Spanish bank notes the direction in whwh 
they are introduced is detected by rapid analysis of the 
central zoneof the edge making entrance by illuminating 
it with white light by reflection and observing whether 
40 the said zone is preferentially white or not. as this would - 
be the case if the note has been introduced with its water 
mark forwards (white zone by reflection) or the other 
way around (a coloured zone). It does not matter during 
this first analysis if some forgeries are not detected as 
« its purpose is simply to classify notes according to their 
denomination and the direction in which they have been 
introduced. Possible forgeries are detected by the exact 
analysis which occurs at a later stage. 

Once the note has been classified, zonal analysis 
so of the same is carried out according to the sequence set 
in the memory of the program stored in the apparatus 
for the said note and position in which it has entered 
Figure12shows an example of the subdivision of a bank 
note into zones for analysis, in which zone 21 corre- 
55 spends to a surface occupied by the water mark, zone 
22corresponds to an area in which the series number 
of the note is printed, zone 23 to a surface which quite 
broadly surrounds the security thread, zone 24 to a part 
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of the surface of the note which presents a strongly col- 
oured scene, due to which it is defined as being suitable 
for chromatic analysis, and zone 25 corresponds to a 
part of the surface selected for analysis under infrared 
illumination, due to the concentration of inks which are 
strongly absorbent of infrared radiation. 

As the different zones to be analyzed are reached 
and while they are being acquired line by line by the im- 
age acquisition system, the different sources of illumi- 
nation are connected as set for the analysis of each 
zone. Likewise, the following are modified: intensity of 
lighting, resolution of the image acquisition system, the 
range of conversion of the digitizer (16), the speed of 
the transport motor..., for each zone, according to the 
settings of the program. 

Even when it is planned to analyze a certain zone 
twice, the direction of movement of the motor is inverted, 
after which forward motion is re-engaged (the second 
time being under different conditions from the first). 
While notes are advancing, their width is measured sys- 
tematically (e.g., in the spaces between areas for anal- 
ysis). Together with checks on width, checks are made 
that the note is parallel to the axis of the guideway, and 
if both checks do not produce satisfactory results then 
it is returned. 

The length of notes is also measured by the number 
of lines acquired during the transit of the same through 
the inspection zone (5). Evidently, this measurement is 
taken into account in the procedure of rejection of the 
same, if it does not coincide with the length assigned to 
it in the program corresponding to the said note. Once 
analysis of the zones of all the bank note has been un- 
dertaken, calculation of the statistical parameters as- 
signed to each zone is carried out, including extraction 
of the foreseen colour profile curves for each zone, and 
calculation of the parameters extracted from the said 
curves. Once all parameters have been calculated, 
these are compared with those stored in the memory of 
the program which correspond to the denomination and 
position of a valid note in agreement with the initial clas- 
sification, it not being necessary to compare the param- 
eters corresponding to the remaining positions of the 
same bank note, nor with those corresponding to other 
denominations. 

As a result of the said comparison, bank notes are 
classified as valid or forged. If they are valid, then the 
note is let into admission mouth B, this admission being 
counted once the note has passed between the pair of 
photoreceptors (7). If the note is invalid, it is expelled 
through entrance mouth A, by activation of the transport 
mechanism in reverse until the note is removed by hand, 
which is detected by the pair of photodetectors (6). 



Claims 



A method for characterizing and discriminating 
bank notes and documents which are legal tender, 



including transport of the note or document to be 
analyzed along a route in which the said document 
is illuminated, and images of the same are acquired 
by a lineal sensor, while analysis of the colouration 
5 of the said images is undertaken, characterized in 
that it includes the stages of: a) identification of the 
denomination and position of the note to be ana- 
lyzed on its entrance into the above-mentioned 
route; b) the selection of certain characteristic areas 
10 of the note depending on its denomination and en- 
trance position, defining these by their dimensions 
and position within the note by their coordinates re- 
specting the original edges of the note; and c) car- 
rying out individual analysis of the said zones under 
is particular conditions which depend on the charac- 
teristics of each zone; having carried out, before im- 
ages of the note are acquired, a self-calibration 
process to compensate for tolerances and devia- 
tions of the image acquisition system: while dunng 
20 the transport of the note successive measurements 
are made of its self-centering throughout the image 
acquisition zone. 

2 A method according to claim 1 , characterized in that 
25 the self-calibration process includes the stages of: 
a) obtaining a first lineal reading without a note and 
illumination, and storing the values obtained which 
correspond to each photoelement of the lineal sen- 
sor, which serve as reference zero for the signal; 
30 and b) obtaining a second lineal reading without a 
note and with illumination by each of the different 
available sources of illumination, and storing the 
values obtained in the memory, these correspond- 
ing to each photoelement contained within the lineal 

35 sensor and for each one of the sources of illumina- 
tion, these representing the bottom of the scale of 
the measuring system or a percentage of the same. 

3. A method according to claim 1 . characterized in that 
40 the denomination and position in which notes are 
introduced are determined by measurement of their 
width and the identification of those characteristics 
that are present at the initial zone of the document. 

45 4 A method according to claim 1 , characterized in that 
once the characteristic zones of the document have 
been selected, each of these is assigned, as partic- 
ular conditions for undertaking its analysis, the type 
and intensity of illumination to be used, the resolu- 
so tion and sensitivity of the image capture system, 
signal processing and the detection of the identify- 
ing parameters for each zone, and the speed of 
transport of the document. 

55 5 A method according to claims 1 and 4, character- 
ized in that zones are defined for multiple analysis, 
in which two or more image acquisitions are made 
under different conditions. 
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A method according to claim 1 , characterized in that 
analysis of the image of each zone is undertaken 
by obtaining curves of the colour profiles, on the ba- 
sis of the colour level distribution matrixes within the 
said zone, and by the extraction, on the basis of 
these curves of parameters of interest, such as min- 
imums, absolute maximums and relative maxi- 
mums, points of inflection, mean value and range. 

A method according to claim 1 , characterized in that 
during the initial phase of the reading of notes, and 
by transmission illumination the position of each 
side of the note in question is detected in the lineal 
sensor, and the origin of coordinates is then as- 
signed to the sensor element corresponding to the 
side of the note that is closest to the start of the said 
sensor; after which successive measurements of 
the positions of the sides of the note are made, on 
its passage through the image acquisition zone to 
check on its being centered. 

A method according to claim 1 , characterized in that 
during the initial phase of the reading of notes, and 
by transmission illumination, successive lines are 
acquired during the advance of the note, and for 
each line the number of elements of the lineal sen- 
sor that are interrupted is analyzed, accepting align- 
ment of the document as correct when this goes 
above a preestablished minimum number of ele- 
ments that are interrupted during acquisition of the 
first lines. 

9. Apparatus for the characterization and discrimina- 
tion of bank notes and documents that are legal ten- 
der, which includes means for transport and guiding 
(1,2,3,4), means of illumination (13, 14), a lineal 
photosensor (8) and electronic means for the 
processing of signals (15,16,17,18,19.20) charac- 
terized in that it contains an optical system that is 
composed of: a lower plate (4) which is translucent 
with a diffusor surface and an upper plate (3) that 
is transparent, between which notes pass within the 
observation zone; at least one frontal mirror (12) 
which directs images to the lineal photosensor (8); 
a corrective diaphragm (11) for luminosity and fo- 
cusing control between the mirror (1 2) andthe lineal 
photosensor (8); and a meniscus lens (9) located 
immediately behind the diaphragm (11 ); and in that 
the means of illumination include an infrared light 
source (1 3), formed by a line of photodiodes which 
are positioned in such a way that they illuminate 
documents by transmission, and a broad spectrum 
light source (14) which is positioned in such a way 
that it illuminates documents by reflection. 

10. Apparatus according to claim 9, characterized in 
that the line of photodiodes of the infrared light 
source (13) is composed of different groupings of 



photodiodes, each of which is powered by its own 
source of electricity. 

11 Apparatus according to claim 9, characterized in 
s that the line of photodiodes presents a higher con- 
centration of photodiodes at its ends than it does in 
the central zone. 

12 Apparatus according to claim 9, characterized in 
io that the broad spectrum light source (14) is com- 
posed of incandescent lamps, preferentially two 
halogen lamps located close to the sides of the ap- 
paratus. 

is 13 Apparatus according to claims 9 and 12. character- 
ized in that between the broad spectrum light 
source (14) and the document there is a filter (12) 
which completely or partially eliminates infrared ra- 
diation. 

14 Apparatus according to claim 9, characterized in 
that the broad spectrum light source (14) is a fluo- 
rescent lamp. 
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25 15 Apparatus according to claim 9, characterized in 
that the lineal photosensor (8) is a lineal CCD colour 
sensor with outputs in red, green and blue. 

16 Apparatus according to claim 9, characterized in 
30 that the lineal photosensor (8) is a group of photo- 
diode triads with filters that are red, green and blue. 

17 Apparatus according to claim 9, characterized in 
that the lineal photosensor (8) is a monochrome Un- 
as eal CCD sensor. 

18 Apparatus according to claim 9, characterized in 
that the electronic signal processing equipment in- 
cludes a video amplifier (15), an analogue - digital 

40 converter (16), and a microprocessor unit (1 7) char- 
acterized in that it also includes a digital - analogue 
converter unit (20) the outputs from which control 
the range of the analogue - digital converter (16), 
the reference level of the video amplifier (15) and 
45 the level of illumination provided by the infrared (1 3) 
and white (14) light sources. 
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